APPLICATION OF OPTIMUM SMOOTHING 
FOR IMAGE DISTORTION CORRECTION 

Ronald A. Werner 

TRW Defense and Space Systems Group 


ABSTRACT 

Optimum linear smoothing is utilized to estimate certain distortions in Landsat-D images. Measure- 
ments that are processed by the smoother consist of designated control point locations within the 
images. Image distortions that are estimated by the smoother are those induced by Landsat-D satel- 
lite navigation errors and slowly-varying attitude and sensor alignment uncertainties. Preliminary 
results indicate that optimum smoothing produces substantially more accurate distortion estimates 
than optimum filtering and that optimum smoothing may reduce the number of control points 
needed to yield a desired image correction accuracy. 
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INTRODUCTION 


Landsat-D is the next of a series of satellites designed to transmit 
imagery data to the ground to support earth resources management. The pri- 
mary payload of Landsat D spacecraft is a thematic mapper (TM) and the 
secondary payload is a multi spectral scanner. The mission objective is to 
produce high quality images of the earth surface for use in agriculture 
monitoring. The TM has seven spectral bands and 30 meter resolution. It scans 
the earth 185 km perpendicular to the spacecraft ground track at 7.4 hz rate; 
spacecraft motion provides the along-track scan. Digitized image data, along 
with spacecraft attitude measurements, are telemetered real time to the NASA/ 
Goddard ground station, where the data is processed to produce high precision 
images: ±5.5 meter (la) registration error and ±9.1 meter (la) total geometric 

error. 

The raw image data contains distortions due to navigation error, attitude 
measurement error, and TM misalignment relation to the attitude reference axes. 

In order to remove these distortions from the image data and thereby achieve the 
precision images that are required, a Recursive Distortion Estimator (RDE) is de- 
signed to estimate the distortions. The measurements used by the RDE are based on 
locations of control points in the distorted image data, together with their known 
locations on the ground. The image of each control point is projected onto the 
ground. Distortion in the image causes the projected position of the control point 
to differ from its known true position. This difference in position is used by the 
RDE to estimate the distortion in the image data. 

Reference 1 suggests a Kalman filter RDE. This document evaluates an optimum 
smoother RDE and compares its performance with that of a Kalman filter RDE. 

SYSTEM DEFINITION 

The system state variables x-, i = 1 through 6, are defined as follows: 

Along-track, cross-track and vertical components of navigated 
position error 



Roll, Pitch, and yaw attitude measurement error plus instrument 
misalignment 
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x \ Along-track, cross-track and vertical components of navigated 
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Roll, pitch, and yaw attitude measurement error drift rate plus 
instrument misalignment rate 


The state differential equations are 



Xi = x i+6 for i = 1 through 6 
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for i = 10, 11, 12 
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where is the j Ln component of spherical (Keplerian) mass attraction 

acceleration for j = 1, 2, 3 and is Gaussian uncorrelated white noise 

for i = 7 through 12. The coefficients in Equation 3 are a^ = 0 and 

b- = -0.00139 sec"^ for i = 10, 11, 12. The standard deviation o 7 . of each 
1 -5 3/2 

component of state noise z,. is: o 7 . = 1.52x10 m/sec for i = 7 and 8, 

r 3 /2 1 i.1 3/2 

= 2.28xl0 _D m/sec ' and a zi = 0.0213 yrad/sec ' for i = 10, 11, 12. 


The standard deviations a of initial uncertainty in each state variable 

x i 

X-j is: 0 = 250m, o = 50m, 0 = 17m, 0 = 291 yrad for i = 4, 5, 6, 

X i X 2 X 3 x i 
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a = 0.05 m/sec, a = 0.02 m/sec for i = 8, 9, and a = 0.4 urad/sec for 
x 7 x i x i 

i = 10, 11, 12. 

The measurements y^ and y^ are defined as the along-track and cross-track 

deviations between the control point image projected onto the ground and true 

position of the control point. The standard deviation of the noise in each 

measurement is: a = 3.0 m and a = 5.0 m. 

1 2 

In addition to the slowly- varying sensor pointing error (caused by 
attitude measurement errors and sensor misalignment) that is estimated by the 
RDE, there is also an uncorrelated (white) pointing error which causes distortion in 
the image data. The standard deviation of the distortion caused by this 
random pointing error is 2.55m along-track and 4.73m cross-track. 

DESCRIPTION OF SMOOTHING ALGORITHM 

The equations for optimum linear smoothing are given in Chapter 6 of 
Reference 2. The smoothing algorithm utilized for the RDE is called a fixed- 
interval smoother in Reference 2. 

METHOD OF ANALYZING SMOOTHING PERFORMANCE 

The RDE performance is evaluated via linear statistical (covariance) 
analysis. Based on an assumed set of control point locations, the state error 
covariance matrix is propagated over the smoothing interval by the smoothing 
equations. The error covariance matrix for along-track and cross-track residual 
distortions are then computed at each point in the image, based on the state 
error covariance matrix at that point and the covariances of sensor random 
pointing errors. 

Several cases that were analyzed were repeated assuming that the RDE is a 
Kalman (optimum) filter. This was done so that Kalman filter performance 
could be compared with optimum smoothing performance. 

SUMMARY OF SMOOTHER PERFORMANCE ANALYSIS RESULTS 

The results of this performance analysis show the smoothing algorithm 
yields substantially more accurate distortion estimation than a Kalman (optimum) 
filter for the identical case. Furthermore, the smoothing algorithm requires 
fewer control points to achieve a desired accuracy. 
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The results also show that the desired distortion compensation accuracy 
can be achieved with one control point every fourth scene for a series of 40 
scenes or by having four control points uniformly distributed over a single 
scene. 
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BACKGROUND INFORMATION 


• LANDSAT-D SATELLITE TELEMETERS DIGITAL IMAGEY DATA FROM 705 Km ALTITUDE 
TO NASA/GODDARD GROUND STATION, WHERE IT IS PROCESSED TO PRODUCE PRE- 
CISION IMAGES OF THE EARTH SURFACE 

• IMAGERY DATA IS PRODUCED BY A THEMATIC MAPER (TM) WHICH SCANS THE SURFACE 
OF THE EARTH 185 Km AT 7.4 Hz RATE PERPENDICULAR TO THE SATELLITE GROUND 
TRACK 

00 

TO 

• THE INSTANTANEOUS FIELD OF VIEW (IFOV) OF THE TM (ONE PICTURE ELEMENT 
(PIXEL)) IS 30 m x 30 m 

• THE RAW IMAGERY DATA CONTAINS SLOWLY-VARYING DISTORTIONS DUE TO NAVIGATION 
ERROR, ATTITUDE MEASUREMENT ERROR, AND TM MISALIGNMENT, AS WELL AS 
UNCORRELATED (WHITE) RANDOM POINTING ERRORS 

• SLOWLY-VARYING DISTORTIONS ARE ESTIMATED BY THE RECURSIVE DISTORTION 
ESTIMATOR (RDE) BY COMPARING THE LOCATIONS OF "CONTROL POINTS" IN A SCENE 
WITH THEIR KNOWN LOCATIONS ON THE GROUND 



OBJECTIVES OF ROE 


ESTIMATE AND REMOVE DISTORTIONS FROM IMAGES SO THAT RESIDUAL DISTORTION 
IS NO GREATER THAN: 

±5.5 m (la) SCENE-TO-SCENE REGISTRATION ERROR 
±9.1 m (la) TOTAL GEOMETRIC CORRECTION ERROR 

MINIMIZE THE NUMBER OF GROUND CONTROL POINTS NEEDED TO ACHIEVE ACCURACY 
REQUIREMENTS 



METHOD OF ANALYSIS 


LINEAR STATISTICAL (COVARIANCE) ANALYSIS 

- STATE ERROR COVARIANCE MATRIX PROPAGATED VIA SMOOTHING ALGORITHM 

- ERROR COVARIANCE MATRIX OF RESIDUAL ALONG-TRACK AND CROSS-TRACK 
DISTORTIONS COMPUTED BASED ON STATE ERROR COVARIANCE MATRIX AND 
STANDARD DEVIATIONS OF UNCORRELATED POINT ERRORS 


KALMAN (OPTIMUM) FILTER PERFORMANCE EVALUATED AS WELL AS OPTIMUM 
SMOOTHING PERFORMANCE 



SUMMARY AND CONCLUSIONS 


- OPTIMUM SMOOTHING BY THE RDE PRODUCES SUBSTANTIALLY MORE 
ACCURATE DISTORTION ESTIMATION THAN OPTIMUM (KALMAN) FILTER- 
ING AND REQUIRES FEWER CONTROL POINTS TO ACHIEVE A DESIRED 
ACCURACY 

- ONE CONTROL POINT EVERY FOUR SCENES YIELDS ONLY MODEST 
DEGRADATION IN ACCURACY RELATIVE TO HAVING ONE CONTROL POINT 
EVERY SCENE 

- DESIRED DISTORTION CORRECTION ACCURACY CAN BE ACHIEVED IN A 
SINGLE SCENE BY HAVING FOUR CONTROL POINTS UNIFORMLY 


DISTRIBUTED OVER THE SCENE 



SYSTEM DEFINITION 


• STATE VECTOR DEFINITION: 
x > ) 

X l ALONG-TRACK, CROSS-TRACK AND VERTICAL COMPONENTS OF NAVIGATED 
2 / POSITION 

X3 ) 


X > ROLL, PITCH, AND YAW ATTITUDE MEASUREMENT ERROR PLUS INSTRUMENT 
5 I MISALIGNMENT 

x / 


s ) 

X \ ALONG-TRACK, CROSS-TRACK AND VERTICAL COMPONENTS OF NAVIGATED 
8 ( VELOCITY ERROR 

X 9 ' 



ROLL, PITCH, AND YAW ATTITUDE MEASUREMENT ERROR DRIFT RATE PLUS 
INSTRUMENT MISALIGNMENT RATE 



SYSTEM DEFINITION (Continued) 


• STATE DIFFERENTIAL EQUATIONS: 

x i = x i+6 ^ or 1 = 1 through 6 
3 3g $ 

Xi = k=l x k + Z i for 1 = 7 ’ 8 ’ 9 

CO 

o 

x i = a i x i-6 + b i x i + z i for 1 = 10 > 11 * 12 

WHERE 

a i = 0, b 1 = -0.00139 sec" 1 

a = 1.52x1 O' 5 m/sec 3/2 for i = 7, 8 

z i 

o_ = 2. 28x1 0" 5 m/sec 3/2 

Z 9 

o z = 0.0213 prad/sec 3/2 for i = 10, 11, 12 



SYSTEM DEFINITION (Continued) 


• INITIAL STATE UNCERTAINTIES: 

a = 250 m 

X 

1 

a = 50 m 

X 

2 

a = 17 m 

X 3 

00 

° a = 291 yrad 

x i 

a = 0.05 m/sec 

X 7 

a =0.02 m/sec 
x i 

a 

x i 


for i = 4, 5, 6 


for i = 8, 9 


0.4 yrad/sec for i = 10, 11, 12 



SYSTEM DEFINITION (CONCLUDED) 


MEASUREMENT NOISE (FOR REGISTRATION) : 

= 3.0 m (ALONG-TRACK) 

1 

a = 5.0 m (CROSS-TRACK) 

2 

UNCORRELATED RANDOM POINTING ERRORS: 

o Rl = 2.55 m (ALONG-TRACK) 

a R2 = 4.73 m (CROSS-TRACK) 



COMPARISON OF KALMAN FILTERING WITH OPTIMUM SMOOTHING 


• REFERENCE CASE REFLECTS TEMPORAL REGISTRATION ACCURACY WITH THE ERROR 
MODELS DISCUSSED EARLIER AND ASSUMES ONE CONTROL POINT PER SCENE FOR 
TEN SCENES 

• KALMAN FILTERING, AS WELL AS OPTIMUM SMOOTHING, IS EVALUATED FOR THE 
REFERENCE CASE 

• THE STANDARD DEVIATION (IN METERS) OF RESIDUAL DISTORTION AT THE TIMES 
WHEN THEY ARE MINIMUM ARE SUMMARIZED AS FOLLOWS: 



KALMAN FILTERING 

OPTIMUM SMOOTHING 


RDE STATE 
ESTIMATION 
ERROR (lo) 

UN- 
CORRELATED 
POINTING 
ERROR (la) 

TOTAL 

RESIDUAL 

.DISTORTION 

(la) 

RDE STATE 
ESTIMATION 
ERROR (la) 

UN- 
CORRELATED 
POINTING 
ERROR (la) 

TOTAL 

RESIDUAL 

DISTORTION 

(la) 

ALONG TRACK 

1.89 

2.55 

3.17 

1.28 

2.55 

2.85 

CROSS TRACK 

2.81 

4.73 

5.50 

1.85 

4.73 

5.08 









COMPARISON OF KALMAN FILTERING WITH OPTIMUM SMOOTHING (Continued) 


RESULTS PRESENTED SO FAR INDICATE ONLY MODEST IMPROVEMENT BY SMOOTH- 
ING RATHER THAN FILTERING. THIS IS BECAUSE THE STANDARD DEVIATIONS 
OF RDE ERRORS WERE TAKEN AT THE TIMES WHEN THEY ARE MINIMUM 

THE FIGURES BELOW SHOW DRAMATIC IMPROVEMENT IN RDE ACCURACY WHEN 
OPTIMUM SMOOTHING IS USED RATHER THAN KALMAN (OPTIMUM) FILTERING 

THESE PLOTS SHOW THAT FEWER CONTROL POINTS ARE NEEDED TO ACHIEVE THE 
REQUIRED ACCURACY IF THE RDE IS A SMOOTHER RATHER THAN A FILTER 

ALL THE RESULTS THAT FOLLOW ARE BASED ON THE ASSUMPTION THAT OPTIMUM 
SMOOTHING IS UTILIZED IN THE RDE 



ALONG TRACK DISTORTION (1® ) (METERS) 


COMPARISON OF KALMAN FILTERING WITH OPTIMUM SMOOTHING (Continued) 



TIME (SECONDS) 
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CROSS TRACK DISTORTION (1<» ) (METERS) 


COMPARISON OF KALMAN FILTERING WITH OTPIMUM SMOOTHING (Continued) 
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ALONG TRACK DISTORTION (la) (METERS) 


COMPARISON OF KALMAN FILTERING WITH OPTIMUM SMOOTHING (Continued) 
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ROE DISTORTION ESTIMATION ACCURACY 
ALONG-TRACK STANDARD DEVIATIONS 
(FOUR CONTROL POINTS OVER ONE SCENE) 
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CROSS TRACK DISTORTION (1*) (METERS) 


COMPARISON OF KALMAN FILTERING WITH OPTIMUM SMOOTHING (Concluded) 

RDE DISTORTION ESTIMATION ACCURACY 
CROSS-TRACK STANDARD DEVIATIONS 
(FOUR CONTROL POINTS OVER ONE SCENE) 


6.0 



TIME (SECONDS) 


REDUCING THE NUMBER OF CONTROL POINTS PER SCENE 


• A TM TEMPORAL REGISTRATION CASE REFLECTING ONE CONTROL POINT EVERY 
FOURTH SCENE WAS ANALYZED 

• THE STANDARD DEVIATIONS (IN METERS) OF RESIDUAL DISTORTIONS FOR THIS 
CASE ARE COMPARED WITH THOSE FROM A CASE WITH ONE CP PER SCENE AS FOLLOWS: 



— ^ 

ONE CP PER SCENE 

ONE 

CP EVERY FOUR SCENES 


RDE STATE 
ESTIMATION 
ERROR (la) 

UNCORRELATED 
POINTING ERROR 
(la) 

TOTAL 

RESIDUAL 

DISTORTION 

(la) 

RDE STATE 
ESTIMATION 
ERROR (la) 

UNCORRELATED 
POINTING ERROR 
(la) 

TOTAL 

RESIDUAL 

DISTORTION 

(la) 

ALONG TRACK 

1.28 

2.55 

2.85 

1.77 

2.55 

3.11 

CROSS TRACK 

1.85 

4.73 

5.08 

2.41 

4.73 

5.31 


« THESE RESULTS SHOWS THAT REDUCING THE NUMBER OF CP's TO ONE EVERY FOURTH 
SCENE DEGRADES TOTAL ACCURACY ONLY SLIGHTLY, AND THE TM TEMPORAL REGISTRATION 
ACCURACY REQUIREMENTS [5.45 M (la)] IS STILL SATISFIED 




LIMITING THE CONTROL POINT REGION TO ONE SCENE 


SEVERAL TW TEMPORAL REGISTRATION CASES WERE ANALYZED THAT REFLECT 
UTILIZING VARYING NUMBERS OF CP's UNIFORMLY DISTRIBUTED OVER A 
SINGLE SCENE IN ORDER TO REMOVE DISTORTIONS FROM THE SCENE 

THE FIGURE BELOW SHOWS HOW THE STANDARD DEVIATIONS OF RESIDUAL 
DISTORTIONS IN THE SCENE VARY WITH THE TOTAL NUMBER OF CP's 
UTILIZED TO CORRECT FOR DISTORTIONS 

BASED ON THESE RESULTS, AT LEAST FOUR CP's (DISTRIBUTED OVER THE 
SCENE) ARE NEEDED TO SATISFY THE TM TEMPORAL REGISTRATION ACCURACY 
REQUIREMENT 

THESE RESULTS ALSO SHOW THAT FEWER THAN FOUR CP's CAN BE UTILIZED 
WITH ONLY MODEST DEGRADATION IN REGISTRATION ACCURACY 



STANDARO DEVIATIONS OF DISTORTION RESIDUALS (METERS) 


LIMITING CONTROL POINT REGION TO ONE SCENE (Concluded) 


TM TEMPORAL REGISTRATION ACCURACY VS. NUMBER OF 
CP'S UNIFORMLY DISTRIBUTED OVER ONE SCENE 
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